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Annual  Report  Summary  for  ONR  Grant  #  N00018-91-J-1540 


We  have  concentrated  our  analysis  on  50  of  over  100  videotapes  acquired  of  trauma  patient 
resuscitation  and  anesthesia.  The  management  of  the  airway  (tracheal  intubation)  in  these  SO 
videotapes  was  classified  into  three  types  of  situatitms:  emergency  (<  10  min  after  patient 
admission),  semi-emergency  (<30  min  afta  patient  admission)  tuid  elective.  Such  a 
classification  allowed  us  to  oHitrast  the  impact  of  stress  on  performance  and  team  activity.  The 
following  data  were  collected  and  analyzed  under  this  classification:  (1)  Subjective  ratings  of 
stress  made  evoy  minute  for  10  min  before  (whoi  available)  during  and  for  10  min  after 
tracheal  intubadtm.  (2)  Transcriptimi  and  coding  of  communications  occurring  during  same  time 
period.  (3)  Plotting  of  patiwit  vital  signs  and  idratification  of  points  where  previously 
constructed  dedsion-trees  are  activated.  (4)  AcquisitiOTi  of  anesthesia  care  providers*  heart  rate 
and  rhythm  electrocardiograms  and  ambulatory  blood  pressure  monitoring  of  anesthesia  care 
provide  during  provision  of  elective  and  emergoicy  airway  management  and  non-anesthesia 
activities.  (5)  Task  analysis  of  tracheal  intubation  and  identification  of  task  omission,  task 
shedding,  relationship  with  subjective  ratings  of  stress  and  performance  of  tracheal  intubation. 
(6)  Inter-rater  reliability  analysis  of  subjective  ratings  of  stress  and  neural  network  oredietjon 
of  perceived  stress  from  weighted  combination  of  subjective  ratings  of  stress.  (7)  Comparison 
of  errors  identified  bv  videotaping  and  self-reports  including  the  anesthesia  record,  anesthesia 
quality  assurance  rqwrts  and  the  questionnaire  completed  immediately  after  videotaping.  (8) 
Examining  Task  Comnlexity  and  its  impli«itinn  for  team  coordination  using  data  from  the  post¬ 
trauma  questionnaire  we  analyzed  task  conditions  in  emogency  and  non-emergency 
circumstances.  (9) 
through  activity  analysis. 


U*)  KU*;  I  •  M, 


As  a  result  of  these  analyses,  we  have  illustrated  several  fiurtors  that  may  have  contributed  to 
untowarded  incidents^*’^^  identified  the  impact  of  task  complexity  on  team  coordination 
patterns^,  and  investigated  the  linkage  between  task  p^ormance  and  communication  failures'^. 
We  found  that  compared  to  other  means  of  inddoit  rqwrting  (e.g.  post-trauma  questionnaire 
and  quality  assurance  rqwrt),  video  analysis  has  the  advantage  of  identifying  the  root  causes  of 
orors^’^.  Through  artifidai  neural  network  simulatitm  and  inter-rater  reliability  analysis,  three 
subjective  ratings  were  found  to  be  reliable  indicators  of  stress:  time  pressure,  workload  and 
uncertainty.  Curroitly,  we  are  primarily  focusing  on  activity  analysis  to  test  several  models  of 
team  cooidinatitm  and  dedsiem-making,  and  on  the  analyses  of  differences  between  expert  and 
novice  performance  and  examination  of  recovery  from  errors. 
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2.  High-Ughte  of  acwmpiishmCTta 

(1)  Phvsiolorical  responses  to  stress  in  real  environment. 

Anesthesia  care  providers  were  asked  to  wear  Holter  (ambulatory 
electrocardiographs)  and  blood  jnessure  monitors  during  trauma  patient 
resuscitation.  We  have  observed  dramatic  differences  in  both  heart  rate  and 
blood  pressure  between  cases  where  padoit  conditions  were  life-threatoiing  and 
those  cases  where  conditions  were  not  so  (Fig.  1).  Curraitly  more  physiological 
data  of  the  anesthesia  care  providers  are  being  collected  and  analyzed. 
Ambulatory  monitoring  of  i^ysiological  data  of  practitioners  in  real  life  situations 
is  difficult,  but  it  provittes  critical  information  about  the  impact  of  stress  and  the 
base  for  evaluating  subjective  assessment  of  stress.  The  data  we  have  collected 
reflect  the  response  of  anesthesia  care  providers  to  stress  caused  by  real-life 
expoioice,  and  are  thus  particularly  valuable. 


HOLIER  MONITOR 


HR  63/min 
BP  1 22/75 
ELECTIVE 
NON-EMERGENCY 
AIRWAY  MANAGEMENT 


HR  156/mln 
BP  156/106 

EMERGENCY  AIRWAY 
MANAGEMENT 


AMBULATORY  BP 


MONITORING  OF  ATTENDING  ANESTHESIOLOGIST 


Fig.  1.  Ambulatory  electrocardiogram  monitoring  of  an  anesthesiologist  during  elective  tracheal 
intubatitm  (tc^  panel)  showing  normal  blood  pressure  and  heart  rate.  The  same 
aiwsthesiologist  two  hours  later  dealing  with  an  emergency  intubation  has  over  twice  the 
heart  rate  (lower  pand)  and  clinically  significant  diastolic  hypertension. 
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(2) 


YidecLanalvsis  as  an  effective  tool  for  diamosing  root  causes  of  human  errors. 
Human  enors  have  been  blamed  as  the  cause  of  many  accidents,  but  eliminating 
human  error  and  alleviating  the  impact  of  errors  is  a  challenge.  One  afqnoach 
is  to  diagnose  the  root  cause  of  these  errors,  be  they  ergonomic,  social,  training- 
related,  or  organizational. 

We  compared  the  results  of  video  analysis  with  three  types  of  leccHds  that  can  be 
used  for  incident  investigations:  post-trauma  questionnaire  (filled  by  anesthesia 
care  providers  immediately  after  each  case),  anesthesia  record  (on-line  logs  of 
anesthesia  cate),  am*  anesthesia  quality  assurance  r^rts,  and  evaluated  the 
values  of  each  as  a  '  r  ignose  the  root  causes  of  errors.  Fig.  2  is  the 
summary  of  the  compiu. 

The  results  of  the  comparison  show  that  video  analysis  can  be  used  to  idmitify 
some  of  the  root  causes  (which  wf  termed  "system  fiulutes”)  of  human  errors, 
whereas  self-rqx)rts,  on-line  l<^s,  aitd  quality  assurance  rqxnts  provide  little 
infrmnation  on  potential  problems  in  ar.af  such  as  training,  equipment,  and  social 
factors  (e.g.  pr^uction  pressures). 

Given  the  advances  in  video  recording  technology,  this  finding  provides  us  with 
adequate  justification  for  using  video  analysis  as  a  means  to  diagnose  causes  of 
human  errors  and  to  make  systems  more  reliable  and  more  ^ficient. 

(3)  Meeting  series  cm  Team  Performance  Analyzing  Techniques  (TPAT). 

We  held  a  series  of  4  meetinp  in  the  Anesthesiology  Research  Laboratories  at 
the  Univezsity  of  Maryland  to  which  we  invited  researchers  woridng  in  the  area 
of  team  performance  in  stressful  environments.  The  participants  included 
(alphab^cal  order)  Richard  Botney,  Michelene  Chi,  Susan  Chipman,  David 
Gaba,  Joan  Hall,  Richard  Horst,  Susan  Kirschbaum,  Colin  Mackenzie,  Judith 
Qrasanu,  Daniel  Serfaty,  Gray  Wanye,  and  Yan  Xiao.  The  themes  of  each 
TPAT  meeting  were  different  a^  relat^  to  video  analysis  techniques,  inter-rater 
reliability  assessment,  communication  analysis  and  decision  modelling.  We 
prqtared  a  white  peqier  summarizing  each  meeting.  As  a  result  of  these  meetings 
two  successful  collaboratimis  occurred.  The  first  was  with  Judith  Otasannu  of 
NASA  and  the  second  with  Daniel  Serfety  of  AlphaTech.  Pre-proposals  have 
been  submitted  to  NASA  and  ONR  for  possible  funding  of  these  collaboratitms. 
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INVITED  PRESENTATIONS 

Colin  F.  Mackenzie,  Horst  RL,  Mahaffey  DL  and  LOTAS  Group.  Group  decision-making 
during  trauma  patient  resuscitation  and  anesthesia.  37th  Human  Factors  and  Ergonomic  Society 
Meeting.  Seattle,  Washington,  October  12-15,  1993. 

Colin  F.  Mackenzie  and  LOTAS  Group.  Trauma  Patioit  Airway  Management.  68th  Clinical 
and  Scientific  Cragress  of  the  International  Anesthesia  Research  Society,  Orlando,  Florida, 
March  5-9,  1994. 


Colin  F.  Mackenzie  and  LOTAS  Group.  Video  camera  in  the  Emergoicy  Room  to  improve 
patient  care.  14th  Myrcm  B.  Laver  International  Postgraduate  Course,  Trauma  Management, 
Dqnrtmait  of  Anesttesia,  University  of  Basel,  Switzerland,  March  18,  1994. 

Colin  F.  Mackenzie  and  LOTAS  Group.  Simulation  of  Trauma  Anesthesia,  The  LOTAS 
Experience.  6th  International  Trauma  Anesthesia  and  Critical  Care  Society.  Paris,  France, 
April  22-24,  1994. 

Colin  F.  Mackenzie,  Panel  Monber.  Current  and  Future  Applicatitms  of  Naturalistic  Decision¬ 
making  with  Healdi  Care.  Naturalistic  Decision-making  Conference  2,  Dayton,  Ohio,  June  13- 
15,  1994. 

Colin  F.  Mackenzie,  Horst  RL  and  LOTAS  Group,  presentation  and  panel  member.  Team 
communicatiems  reveal  the  root  causes  of  performance  i^lems  observed  in  airway  management 
of  trauma  patients.  12th  Triennial  Cmigress  of  the  Intranadonal  Ergonomics  Association, 
Toronto,  Canada,  August  15-19,  1994. 

Colin  F.  Mackenzie  and  LOTAS  Group.  Human  Factors  in  Emergencies.  Human  Error/Human 
Factors  Course  at  FDA,  Bethesda,  hforyland,  October  6,  1994. 

CONTRIBUTED  PRESENTATIONS 

Craig  GR,  Forrest  FC,  Mackenzie  CF,  Parr  MJ,  Bodim  C,  Gorman  G  LOTAS  Group: 
Poformance  of  Trauma  Anesthesiologists  Assessed  by  a  Synthetic  work  oivironmoit. 
Anesthesiolc^  79:A535,  1993.  Presented  at  the  American  Society  of  Anesthesiologists  Annual 
Sdaitific  Me^g,  Washington,  DC,  Octob^  9-13,  1993. 

Bernhard  WN,  Mackenzie  CF,  Hu  PFM,  Horst  RL,  and  the  LOTAS  Group.  A  video 
acquisititMi  systems  (VASNu'i*)  for  remote  monitoring  of  the  clinical  environment.  9th  Asian 
Australasian  Congress  of  Anaesthesiologists,  Bankok,  Thailand.  November  11-12,  1993. 

Martin  P,  Mackmzie  CF  and  the  LOTAS  Group.  Stressors  occurring  during  Emergoicy 
Tracheal  Intubatitm.  Emergency  Medicine  and  Critical  Cate  Society  Meeting,  Cambridge, 
England,  Sq)tember,  1993. 

CFM/abe 

AmhLONR 


5 


ONR  ANNUAL  PKODUCTTVITY  REPORT,  01  OCT  1993  TO  30  SEPT  1994 

Send  To:  DR.  SUSAN  E.  CHIPMAN 

OFFICE  OF  NAVAL  RESEARCH 
CODE  342  CS 
BALLSTON  TOWER  ONE 
800  NORTH  QUINCY  STREET 
ARLINGTON,  VA  22217-3660 

FAX:  (703)696-1212 


Principal  Investisator  Name:  Colin  f.  Mackenzie,  m.d. 

Institution:  University  of  Maryland  At  Baltinore 

Project  Title:  Developnent  and  Enhanceaent  of  a  Model  of  Perf  onance  and  Decision- 
Making  Under  Stress  in  a  Real-Life  Setting 

Number  of  ONR  supported: 

Papers  published  in  refereed  journals:  3 

Papers  accepted  for  publication  in  refereed  journals: _ 

Papers  or  reports  in  non-refereed  jonmais:  2 
Books  or  book  chapters  published:  - 
Books  or  book  chapters  in  press:  - 

Papers  Subnitted  in  refereed  journals:  4 
**  Attach  list  of  papers  and  other  publications  with  fufl  citation.** 

Number  of  ONR  supported  patenta^ventions  filed  0  or  granted  o  ,  with  patent 
numbers: 


**  Attach  title  aod  brief  description  of  patents/inventions,  if  any.** 


Number  of  Preseutations: 


Trainee  Date: 


Invited:  6 

Contributed:  3 

TOTAL  FEMALE  MALE  MINORTTY 


NON-US  CITIZENS 


No.  of  Grad.  Students  4 
No.  of  Postdoctorais:  1 

No.  of  Undergraduates:  ~ 


1 


3 


1 


1 


